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DESCRIPTION 

METHOD OF CONTENT ADAP TATION FOR APPARATUSES 
OF~ UNIVERSAL MULTIMEDIA FRAMEWORK TERMINAL, 

SERV ER, AND GATEWAY 

5 TECHNICAL FIELD 

The present invention relates to a unified multimedia terminal that can 
access multimedia content in different formats, and relates to a unified 
multimedia framework that can handle different multimedia terminal, network, 
usage environment. 

10 BACKGROUND ART 

MPEG and other standard bodies have created many standards in video, 
audio, system, communication protocol, content representation, content 
packaging, etc., to ease for content transfer and deliver from one place to 
another in an efficient way, as well as content storage with big volume in a 

15 limited space. 

As a result of it existing contents can be found in different formats due to the 
different source coding methods, MPEG1, MPEG2, MPEG4, DV, DVCPRO, etc, 
and at the same time devices and terminals are also built in different scope to 
be compliant with certain standard but not with another. For example, a DTV 

20 STB (Set-Top-Box) can decode and play back MPEG-2 compliant content but 
cannot play back DV content, or MPEG-4 content 

It would be desirable that there has a universal multimedia terminal, which 
can access and consume any content no matter what format it is. There are a 
few ways to achieve this. 

25 One way is to build a terminal that has a powerful transcoder function to 
understand all the different formats and decode them in real-time, then encode 
the content into the required format in real-time. But the cost would be very 
high for having such a real-time multifunctional transcoder. It is definitely not 
advisable to use for portable terminal, even for DTV, or DVD like devices. 
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Another way is to have such transcoder function in service provider side / 
content creation side, or in a gateway site, to pre-transcode and store the same 
content in different formats. 

In such case a set of descriptions or metadata to describe content 
5 representation format can be created and attached to the corresponding content. 
By matching a query submitted by a terminal with the stored metadata in a 
server, the server will decide which content in the specific format will be 
delivered to the terminal. Here the terminal has to be a compliant terminal, to 
be able to generate a set of pre-defined descriptions or metadata that the server 
10 can recognize. 

Besides the set of descriptions to address content representation format, a 
set of descriptions to describe terminal, as well as set of descriptions to 
describe other usage environment including network condition and user 
preference, is also required to define. However usage environment is different 
15 from content representation format and terminal, and it is changeable and 
selectable and not fixed with the terminal like terminal decoding capability. 

Here this invention is focusing on defining a set of descriptions and the 
structure among the descriptions, as well as to define a mechanism for a 
multimedia framework used across different terminals and network. 
20 This invention is to try to solve the following problems: 

The same content or media resource in certain format can be accessed, 
retrieved, and consumed by any multimedia terminal with different network 
condition and different user preference. 

A terminal with different decoding capability and network condition is able to 
25 access, retrieve, and consume any content or media resource that is in different 
data formats. 

DISCLOSURE OF INVENTION 

By defining a set of descriptions for content representation format, a piece of 
content or media resource can be described to reflect its coding format and 
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style, where the set of descriptions can be defined based on coding condition 
according to certain coding standard, and also based on parameters extracted 
from the bit stream headers. 

By defining a set of descriptions for a terminal, the terminal can be described 
5 to reflect its conformed decoding capability. 

By defining a set of descriptions for a terminal, the terminal can be described 
to reflect its processing power, memory, operating system, etc. Such 
description is sent to a server from the terminal before the server can deliver 
content in the right coding format. 
10 By defining a set of descriptions for network, the network condition which a 
terminal is connected to, can be described to reflect communication protocol, 
average bandwidth, delay status, packet loss status, etc. 

By defining a set of descriptions for user preference, user's interest and 
preference can be described to reflect user's choice and selection. 
15 By defining the hierarchy and structure of the above descriptions, a 
multimedia framework can be built for content delivery to any terminal via any 
network. 

By defining the hierarchy and structure of the above descriptions, a terminal 
can be built to form a universal multimedia terminal that may have limited 
20 decoding capability. 

By defining a mechanism used for constructing a multimedia framework, 
many of the existing and future applications can be served for more users who 
have different terminals and different network. 

Operation of the Invention 
25 On the terminal side: 

A MPEG-21 Terminal is built by implementing one of the source coding tools 
like MPEG-4 Video decoder for simple profile; 

A MPEG-21 Terminal is built by implementing one of the system coding tools 
like MP4 file format; 
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A MPEG-21 Terminal is built by implementing one of the Transmission tools 
like RTP; 

A MPEG-21 Terminal is built by implementing MPEG-21 DID (Digital Item 
Declaration), REL (Rights Expression Language), RDD (Rights Data 
5 Description), IPMP (Intellectual Property Management and Protection), and DIA 
(Digital Item Adaptation) Parser; 

A MPEG-21 Terminal is built by setting-up a table to describe the terminal's 
characteristics such as compliant decoding format including source coding 
format, system layer coding format, transmission format, where the table can be 
10 expressed in XML (Extensible Markup Language 1.0) schema or in SDL 
(Syntactic Description Language) syntax, where more detail descriptions will be 
included in each type of coding format, such as bit rate, display window size, 
buffer size, etc. 

On the content server side: 
15 A content or media resource that is in certain data format is pre-transcoded 
into different data formats with its defined metadata or a set of defined DIA 
descriptions to describe each type of formats according to. MPEG-21 DIA 
defined structure. 

MPEG-21 Digital Item (Dl) is generated by constructing a scene structure 
20 where the corresponding DID/IPMP/REL/RDD/DIA descriptions are structurally 
linked together to tell you what is the digital item and where is the media 
resource, how it is protected, what are the rights for using the Dl, and what is 
the possible terminal and network adaptation listed in form of "choice" for the 
media resource in order to be delivered and consumed by users. This is used 
25 for two-way interactive application. 

For one-way application like broadcasting, MPEG-21 Digital Item will be 
created according to the specific terminal and network condition received from 
terminal. 

It should be noted that the terms and definitions given in the following apply: 
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one-way Application; 

Fig. 10 shows Illustration of MPEG-21 Terminal with DIA Description used in 
Interactive two-way Application; 

Fig. 11 shows Real-Time Adaptation Framework for Streaming Content 
5 Delivery; and 

Fig. 12 shows a Generic Adaptation Framework to a Terminal with Different 
Network Condition and User Preference. 

* 

BEST MODE FOR CARRING OUT THE INVENTION 
10 The prior art is illustrated in Fig. 1 and Fig. 2 to state the current situation 
where a content in certain data format cannot be played back by different 
terminals. 

In Fig. 1, it is shown that MPEG-2 MP@ML content is delivered from 
Multimedia server in module 11 to user in one-way, and only DTV STB in 
15 module 1.4 can play back. The other terminals in module 1.2, 1.3, and 1.5 
cannot play the content. 

In Fig. 2, it is shown that MPEG-2 MP@ML content is delivered from 
Multimedia server in module 2.1 to user in interactive two-way, and only DTV 
STB in module 2.4 can play back. The other terminals in module 2.2, 2.3, and 
20 2.5 cannot play the content. 

From the above examples it is understood that such situation limits the 
content accessibility by a broad range of terminals and network. 

On the other hand, it is not possible for terminal to be built to enable 
decoding all different formats of content, which is too much costly. 
25 The following embodiments are arranged in the two major sections: 

Hierarchy DIA Descriptions for adaptation to different terminals used in 
Interactive Two-way or One-way applications and real time streaming 
adaptation to different network; 

Interactive Two-way application case 
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The interactive application is very popular in existing world, such as DTV 
Interactive data broadcasting, Internet based services, Interactive DVD, 
Interactive data access by Mobile phone, etc. 

Typical model for this two-way application is that server provides a layer 
5 structured menu to be viewed by User, User selects what he want to retrieve by 
sending request to server from a client terminal, and the server processes the 
request and delivers the requested content to the client terminal. 

Here the content is referred to media resource in MPEG-21 . 

As shown in Fig. 3, MPEG-21 Multimedia Server is illustrated in module 3.1 
10 where content or media resource is stored attached with a set of DIA 
descriptions. 

In module 3.11 a MPEG-21 terminal is shown and it consists of source 
coding tool in module 3.10, system layer coding tool in module 3.9, transmission 
protocol in module 3.8, as well as MPEG-21 DIA parser and a set of DIA 
15 descriptions in module 3.7. The terminal is connected to TCP/IP, UDP, ATM, or 
other network in module 3.6. 

The case what we are talking here is corresponding to Case 2: Two-way 
Interactive Application shown in Fig. 3. First of all, the terminal or user will 
browse a Digital Item, parse the DID/IPMP/REL/RDD and DIA descriptions 
20 based on what a user selects in module 3.5. The server delivers the content 
with matched data format to the terminal according to the choices made by the 
terminal, in module 3.4. 

In the above interactive process, the information received by the server 
consists of two types: User involved and Non-user involved, 
25 1) User involved information: those requests or choices made by the user 
during the browsing, such as user preference; 

2) Non-user involved information: the terminal characteristics sent from the 
terminal automatically when the DIA descriptions are parsed through the DIA 
Parser in the terminal. 
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One-way Broadcasting Application Case 

In this way, terminal is not supposed to communicate with the server 
interactively like two-way application. 

As shown in Fig. 3 for Case 1: one-way Application, the terminal needs to 
5 initiate the content delivery by sending a request with a set of DIA descriptions, 
to tell the server "what I am° and "what I can do" in module 3.2. The server 
processes the request and the set of DIA descriptions to transmit the content 
with the matched format to the terminal, in module 3.3. 

There are two types of DIA descriptions. One type is related to terminal 
10 characteristics, such as terminal complaint decoding format, terminal process 
power, etc., and this type of the descriptions is fixed with the terminal and not 
likely be selected by User; while the other type is related to network condition 
and user preference which is not fixed with the terminal and it is changeable 
with different network condition and different user preference. 
15 No matter one-way or two-way applications, those DIA descriptions related 
to terminal characteristics have to send to the server by terminal not by user. 
For one-way application they can be submitted to server during communication 
starting period, while for two-way application they can be submitted to server in 
the beginning or in the middle way of interactive communication. While those 
20 DIA descriptions related to network condition and user preference can be given 
by user or network protocol that is used in the communication during the 
delivering process. 

Hierarchy Description for Each Coding Layer 

As shown in Fig. 4, a general media resource in module 4.1 can be in the 

i 

25 form of text, graphics, still image, audio, video, which are considered as source 
coding format in module 4.2. 

If there is combination of audio and video, system coding is required as 
shown in module 4.3 to synchronize audio and video, such as MPEG-2 
Transport system and Program system which are widely used in the products. 
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"Size": device screen size in unit of pixels, composed of the horizontal and 
vertical values; "SizeChar": device screen size in units of characters, composed 
of the horizontal and vertical values and determined by device's standard font; 
"BitPerPixel": the number of bits of colour or grayscale information per pixel, 
5 related to the number of colours or shades of gray the device can display in 
screen; "PointingResolution": the type of resolution of the pointing accessory 
supported by device screen. 

Hardware Support: indicate whether the terminal supports "Colour" (colour 
display), Textlnput" (text entry), "Imagelnput" (image display), "Voicelnput" (any 
10 form of voice input), "SoftKey" (Programme soft keys) and "SoundOutpuf 
(sound output through external speaker); Boolean type is used to denote all 
these supports, e.g. "yes" for "Colour* support means the device's display 
support colour"; 

AssitHardware: some assistant hardware supporting security functionality, 
15 "SmartCard", "Hardkey"; . 

OS: Vendor, Name, Version, SerialNumber of the terminal's operating 
system, e.g. Apple Mac OS, 9.0, 12345678; 

VM: Vendor, Name, Version of the virtual machine installed on the device, 
e.g. SunJRE1.2; 

20 Firmware: Vendor, Name, Version of the firmware to which the device's low- 
level software conforms; 

Software Support: indicate whether the terminal supports "Software 
download", "Browser 8 with its name and version; 

System property is also an important aspect for terminal description. 

25 General description of terminal system including processing "Modules", e.g. 
extra terminal tools for some special functionalities' performing, interconnection 
of "Components" and the support of "Configuration" option. For MPEG-21 
multimedia framework, the special system property "IPMP" should be provided. 
The IPMP system description includes residing IPMP_Tools with their ToollD 
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H.26x consists of H.261 and H.263, and mainly used in videoconference 
products; 

M-JPEG is motion JPEG; 

WMV is Window Media Video used widely in PC world; 
5 Real Video is another type of video format used in the product of Real 
Network; 

In the same way as video, Audio and speech also need to cover different 
formats: MPEG-n audio like MPEG Layer 2, MP3, MPEG2-AAC, MPEG4-AAC, 
and G series like G. 721/2, G.723, G.726, G.729, etc. Image and graphics 
10 covers various types of formats, like JPEG, JPEG-2000, GIF, TIFF, XBM, PICT, 
etc. 

DIA description to describe a content structure and a terminal is shown in Fig. 

7. 

In module 6.1, DIA descriptions are listed to describe a media resource, 
15 while in module 6.2, DIA descriptions are listed to describe a multimedia 
terminal. 

In the front of a content structure, a set of DIA descriptions is always 
attached by described the detail coding structure of the content, as shown in 
module 6.3. 

20 On the other hand, for a given terminal a set of DIA descriptions is always 
requested to be implemented with the terminal to describe the terminal 
decoding capability and its processing power, as shown in 6.4. 

From Fig. 7, it is clear that two formats in module 6.1 and 6.2 do not match 
and adaptation is required to enable the same content for the media resource 

25 can be consumed by the terminal. 

The ideal adaptation is to rely on a real-time Adaptation Gateway that 
contains transcoding module. Once the adaptation gateway receives such DIA 
descriptions as listed in module 6.1, it will convert or transcode the coding 
format to fit for the DIA description as listed in module 6.2 for consuming 
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leimi „a, oom.be server. ™s oase - for On. « V ^ ^ ^ 

^ implement is shown J- ^ ^ „ descrt6ed 

10 A termtnat in modute 91 brow ^ 

DID/ReUTOD/IPMP/OIA ^ '^^Bon or user preference In (2). 
to M ca,e fermtna, ^ tem ina, character 

Th ore are two ways for server « acq ^ p) as shovm ,„ 

— — CMm *TL 21 OIA Descdpbons ,o me server. 

15 Fig. 10. me fermlna, w, ^ ttrmina , ^edstics in me case 

andanomarwayisfoletusardeodefor ^ ^ ^ wlth 

the user Knows abou, Mr any ^ ^ „ 

mat ched ooding forma, as an adapted m 

temtinal in (4). ,^, ud es its oomplaW coding capability and 

20 Here Temilna, «— — - > etc . ^ ma tamilnafs 

als o its proofing P--~T^ ,o Confan, Represent Ponoa, 

^pialn, coding capable ''""T^V „ me same daemons ou, 
malisusedfodescdbeamed^esoo r ^ ^ ^ or 

just using different terms tor 
25 content/media resource. n w«rert Network: 

R ea, time Slreaming ^^^^ .pes of DIA Damons: 
*s explained in me above, mare are W ^ which , s fixe0 and 

F *ed D-H— .o ^^^sfodascdPane^condUion 
cannot be changed, and Changeable Das 
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and user preference, which is not fixed with the terminal, and it can be different 
as network used is different or changed, or user preference is different or 
changed. 

The former descriptions with their hierarchy structure as well as the 
5 mechanism to signal adaptation and transcoding are shown in the above 
sections, and the later descriptions and the mechanism to signal between a 
server and a client terminal is described in this section. 

It is assumed that the same coding format is used for a media resource and 
a terminal. Due to different network condition like different bandwidths the 
10 media resource needs to be adapted to the changeable condition by any means, 
including using scalable coding techniques in source coding layer and also 
application network layer. 

There are many ways to change bit rate in real-time to adapt to changeable 
network. These include SNR scalable coding, adjusting bit rate controller, 
15 reducing frame rate, truncating bits for enhancement layer, employing Qof 
(Quality of Service), etc. All of these are considered as different kinds of 
adaptation tools, and they can be different in different cases. 

In Fig. 11, a real-time adaptation framework is shown to illustrate the 
streaming case where network condition and user preference is fed back to a 
20 server all the time so that the server uses such information to determine what 
kind of media resource should be delivered to a terminal to match with the 
suitable bit rate. 

As shown in Fig. 11, a MPEG-21 multimedia server is shown in module 10.1 
where DIA Parser, Adaptation Tools, and Media Resources are included. A 
25 MPEG-21 terminal is shown in module 10.2 with DIA Description Generator in 
module 10.5 to generate DIA descriptions according to the Network Condition in 
module 10.3 and User Preference in module 10.4. 

In module 10.6 a set of descriptions is listed as an example to illustrate what 
are the possible items needed to submit to the server. 
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„u. a 10 7 in the server is to process the received DIA 
Resource ,n module 10.9 oo ^ is described 



server to the client terminal. illustrate how the 

A ^ ar : — ^r:r^ a — * 

adaptation is performed for a give" 

different netwoAcondifion and user preference ^ 
MPEG . 2 1 Multimedia Server is shown m mod >e - ^ ^ 

«— rr rr: : r: a tiu . * *~ an d 

side. Contents are stored in the server a 

delivered to user based on request. where DIA Descriptions 

MPEG . 2 1 Ciient Terminal Is shown ,n module 11 A _ 
to dasoriPe its decoding capacity and processrng 
well as a DIA Desertion oMine general module foge^ a. 

- — rrsrr^r— - - - - - 

Dunng the start.ng ^ ^ jn ^ arrow of 

DIA descriptions on Term.nal Capability 



10 



15 



20 

'a' 



- toaart,he User Prefere „ce in module 11.4 wit. 
Network Condition in module 1 1 .3 and ^ u|e , , s 

^ hacK - — nefwodr conation and us. ^ 

- DIA — ^ and User ,o 
send the set of DIA descriptions on Networ 

« serve,, as shown in the arrowo. V. „ 

User.nta.acelss^in^dulo^ ^ ^ .„ 
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• ih P server side will process the 
* shown in module 11.7. DIA Parser „ * ^ ^ 

received DIA descnptions from the ten^n ^ ^ 

form the server or piug-in tools to convert ^ ^ 

source into the matted med.a resource to 
5 and approve network ^ ^ "on the server side, and . can 

Ada pta«on too, are *^£2« " — " * * ' ^ 

al so be cemented in a m.dd e ada ta 9 ^ ^ ^ ^ ^ ^ be 

Resources shown in module 11-9 , ar coding formats, 

^«r«i in the server to target on *» 
transcoded and stored tn ^ ^ time . 

rrr by Huan9 Zhon9yan9 

(Panasonic Singapore l*"*^ 

<xs:schema J ^^eFormDefau^-unqualif.ed'^ 

e lementFormDefault=»qua1>f.ecf attnbu 

<xs:e.ement name- 'TERMINAL > 

ocs:annotation> description of terminal 

<xs:documentation>H 9 >ve the 

caP abilities</xs:documentation> 

</xs:annotation> 

<xs:complexType> 

_ ma vOccurs="unbounded > 
<xs- sequence maxuccui » 

» ^-"General" minOccurs- 0 
<xs:element name- ^ene. 

1 



15 



20 



<xs:complexTy P e> ^ 

^.sequence ml nOccurs=»0»> 
<xs:element name= Dev.ce__iyp 



<xs:simpleType 
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15 



20 



minOccurs="07> 



25 minOccurs= M 07> 
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<xs: restriction base="xs:string ,, > 
<xs:enumeration value="Decoder7> 
<xs:enumeration value- 'Encoder7> 
<xs:enumeration value- 'Gateway7> 
<xs:enumeration value- 'Router7> 
<xs:enumeration value="Camera'7> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs:element name- 'Device_Class" minOccurs= M 0"> 
<xs:simpleType> 

<xs:restriction base="xs:string"> 
<xs:enumeration value="PC7> 
<xs:enumeration va!ue="PDA7> 
<xs:enumeration value- 'STB7> 
<xs:enumeration value- 'Printer7> 
<xs:enumeration value="MobilePhone7> 
<xs:enumeration value- '"/> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 



<xs: element 



<xs:element 



name-Vendor" 



name-Model" 



type="xs:string" 



type= H xs:string" 



</xs:sequence> 
</xs:complexType> 
</xs:element> 

<xs:element name="Hardware" minOccurs="0"> 
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<xs:complexType> 

<xs: sequence maxOccurs= M unbounded"> 
<xs:element name="CPU M minOccurs= n O M > 



use="optional"/> 



use="required"/> 



10 use-'required"/> 



15 



use="optional7> 



use="required M /> 



20 use-'required"/> 



25 



use="optional"/> 



use= M required'7> 



<xs:comp!exType> 

<xs:attribute name- Vendor" type="xs: string" 

<xs:attribute name-Model" type="xs: string" 

<xs:attribute name="Speed" type="xs: integer" 

</xs:complexType> 
</xs:element> 

<xs:elernent name="Memory" minOcx:urs="0"> 
<xs:compIexType> 

<xs:attribute name-Vendor" type="xs:string" 

<xs:attribute name-'Model" type="xs:string M 

<xs:attribute name-'Size" type- *x$: integer'' 

</xs:complexType> 
</xs:element> 

<xs:element name="Speaker" minOccurs="0"> 
<xs:complexType> 

<xs: attribute name-Vendor" ty pe="xs: string" 

<xs:attribute name='Type" type="xs: string" 

</xs:complexType> 
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<jxs:element> ire _»n"> 
. o mo -"Kevboard" minOccurs- o > 
<xs:element name- KeyDu* 

< XS :complexType> type =»xs:string" 
<xs:attribute name='Vendof VP 



5 U se=«o P tionaVV> _.^ hllte nam e='Ty P e" type='*s:stnng 



use="required"/> 



<xs:attribute 

</xs:comp»exType> 
</xs:element> 



10 



<xs:element name="Screen" minOccurs=»0»> 

<xs:comp»exType> 

<xs:sequence maxOccurs="unbounded 

<xs:element name="Size"> 
<xs:complexType> 

<xs:attnbute name="hcr,zonta» 

15 type ="xs:intager use="required»/> nam e=»verticar 

vs inteaer" U se="required"/> 
type- xs.mteg </xs: complexType> 

</xs:e»ement> 

20 <XS :e.ement name=»SizeChar" minOccurs- 0 

<xs:complexType> 

<xs:aunbute name="honzontal 

type =»xs:,nteger" use-required^ name= . V erticar 

type="xs:integer use="required'7> 
yH </xs:comp>exType> 

</xs:element> 

na me="BitPerPixel 

<xs:element 
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type- *xs: integer" min0ccurs="07> 

<xs:element name-'PointingResolution" 
type- *xs: string" minOccurs- ! 07> 

</xs:sequence> 

5 </xs:complexType> 

</xs:element> 

<xs:element name-'Support" minOccurs="0 M > 
<xs:complexType> 

<xs:sequence minOccurs="0" 

10 maxOccurs= f, unbounded"> 

<xs:element name- 'Color" minOccurs="0"> 
<xs:complexType> 

<xs:attribute name="Capability" 

type="xs:boolean" use- 'required7> 
15 </xs:complexType> 

</xs:element> 

<xs:element name="Textlnput" minOccurs="0"> 
<xs:complexType> 

<xs:attribute name="Capability M 

20 type="xs: boolean" use="required'7> 

</xs:complexType> 
</xs:element> 

<xs:element name= l, lmagelnput" 

minOccurs="0"> 
25 <xs:complexType> 

<xs:attribute name-'Capability" 

type="xs:boolean" use="required7> 

</xs:complexType> 

</xs:element> 
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<xs:element 

m\nOccurs="0"> <XS :complexType> 

<xs:attribute 

5 ^^^..^Ty^ 



name^Voicelnput" 



name="Capab«ity" 



</xs:element> . r o-"n"> 
<„:e.emen. na^-So^ -Me— 

< x5 :co m p.exType> apabl , ity .. 
<xs:attribute 



10 



■* S ' elemen " naroe -SoundOutpuf 
<xs:element 



name^'Capability" 



15 minOccurs^'O^ <XS ; C omplexType> 

<xs: attribute 

^.toa.ean" — ^'"^^^ 

</xs:element> 

20 </xs:sequence> 

</xs:comp»exType> 

</xs:element> m -, n Occurs="0"> 

-,»-»A«!s'rtHardware' minuccuio 
<xs:element name- Assitna 

<xs.comp»exType> mi nOccurs="0" 
25 <xs:sequence 

^Occurs-unbounda*^ ^ n^a-SmaCCa*" 
minOccurs^'O'^ 
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<xs:complexType> 

<xs:attnbute name='Vendor" 

type^stnntf' use=«cptionar/> ^ ^ name ="Moder 

5 type="xs:string" use="required"/> 

yH </xs:complexType> 

</xs:element> 

<xs:e>ement name="HardKey" minOccurs="Cr> 

<xs:complexType> 

4k rf£ft name= l, type M 
<xs:attnbute 

10 

tV pe= D xs:string" use="required°/> 
J </xs:complexType> 

</xs:e1ement> 

</xs:sequence> 
</xs:complexType> 

15 

</xs:element> 
</xs:sequence> 
</xs:complexType> 

</xs:element> 

20 <xs:element name=»Software» minOccurs="0»> 

<xs:complexType> 

<xs sequence m axOccurs="unbounded»> 
<xs:element name="OS» minOccurs="0"> 
<xs:comptexType> 

„rr, Q -'Vflndor" type= xs.stnng 
<xs:attribute name- venaor w 

25 

use="optiona»"/> . 1Klame ,. type="xs: string" 

<xs:attribute name- Name w 

use="required'7> m «-.v*»rsion" type="xs:floaf' 

<xs:attribute name- Version w 
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use= n required7> 



<xs: attribute 



name^'SerialNo" 



type^VsinonNegativelnteger" use="optionar/> 

</xs:complexType> 
</xs:element> 

<xs:element name="VM" minOccurs="0"> 



10 



use="requirecT7> 



use="required"/> 



use =,, required'7> 



15 



20 



use="required ,, /> 



use="required7> 



use="required"/> 



25 



<xs:complexType> 

<xs:attribute name='Vendor" type="xs:string" 

<xs:attribute name-Name" type-'xsistring" 

<xs:attribute name- Version" type-'xsistring" 

</xs:complexType> 
</xs:element> 

<xs:element name="Firmware" minOccurs- '0 M > 
<xs:complexType> 

<xs: attribute name- Vendor" type- f xs: string" 

<xs:attribute name="Name" type="xs:string" 

<xs:attribute name- Version" type="xs: string" 



</xs:comp!exType> 
</xs:element> 

<xs:element name- 'Support" minOccurs="0"> 
<xs:complexType> 

<xs:sequence minOccurs="0" 

maxOccurs="unbounded"> 
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name="Download n 

<xs:element 

n«nOccurs=«0«> <xs:C o m p.exType> 

<xs:attnbute narne--"Capab,Uty 

c t V De="xs:boolean"use="required'7> 
5 type xs.u < /xS :comp»exType> 

</xs:element> 

<xs:elementnama=»Browser» minOccurs- 0 

<xs:complexType> 

M if<a name="Name 
<xs: attribute 

10 

type =«xs:string" use=»required«/> nam e='Version» 



it 



type ="xs:float" use="required"/> 



15 



20 



25 



</xs:comp»exType> 

</xs:element> 
</xs:sequence> 
</xs:complexType> 

</xs: element* 
</xs.sequence> 
</xs:complexType> 

</xs:element> 

< XS :elementname=»System" minOccurs- 0 

<xs:complexType> 

^sequence maxOccurs-unbounded 

^..etement nama^Genara," m.nOccura- 0 
<xs:complexType> 

<xs:sequence minOccurs="0"> 

♦ „ome="Modules" minOccurs- o > 
<xs:element name- wiouu. 

<xs:comp»exTy P e> 
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<xs.attribute 



na me="ModulelD" 



type--^:^^ nam e=»Processing» 



WP </ X sxomplexType> 

5 

</xs:element> 
<xs:element 

minOccurs="0 M > 



name^'Components" 



<xs:complexType> 

<xs:attribute name="ComponentlD" 

10 

ty pe=^s:unsigned»nr ^^^^^ nam e=»»nterconnect» 

tV pe="xs:boolean" use="required'7> 

tyP </xs:complexType> 

</xs:element> n 
15 . mont name= M Configration 

<xs:element 



name="Option" 



minOccurs="0"> . vTune> 

<xs:complexType> 

<xs: attribute 

20 type="xs:boolean" use="required"/> 

20 w </xs:complexType> 

</xs.element> 
</xs:sequence> 
</xs:complexType> 

</xs:element> 

25 <xs:element name="lPMP" minOccurs="0"> 

<xs:complexType> 

<xs:sequence minOccurs="0"> 

<xs:element name=»Resid,n g Too,s 
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minOccurs-'O" maxOccurs="unbounded"> 

<xs:complexType> 

<xs:attribute name-Tool ID" 

type="xs:unsignedlnt M /> 
5 </xs:complexType> 

</xs:element> 

<xs:element name="RDDREL" minOccurs="0 f, > 
<xs:complexType> 

<xs:attribute name^'Capability" 

1 0 type^'xsiboolean" use="required7> 

</xs:complexType> 
</xs:element> 
</xs:sequence> 
</xs:comp!exType> 
15 </xs:element> 

</xs:sequence> 
</xs:complexType> 
</xs:e!ement> 

<xs:element name= M CodingCapability" minOccurs= M 0 M > 
20 <xs:complexType> 

<xs:sequence maxOccurs="unbounded ,f > 
<xs:element name="Audio" minOccurs- '0 M > 
<xs;cx3mplexType> 
<xs:choice> 

25 <xs:element name= M MPEG"> 

<xs:complexType> 

<xs:sequence maxOccurs="unbounded n > 
<xs:element name="MPEG-1 " 

minOccurs="0 M > 
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<xs:complexType> 

<xs:sequence> 

<xs:element name="Layer"> 

<xs:simpleType> 
<xs:restriction 



base=* , xs:string ,, > 



<xs: enumeration 



value=T7> 



<xs: enumeration 



10 value="H"/> 



<xs: enumeration 



value="IH M /> 



15 



20 minOccurs="0"> 



name 



="LowSamplingRateLayer"> 



25 



</xs:restriction> 
</xs:simpleType> 
</xs:element> 
</xs:sequence> 
</xs:complexType> 

</xs:element> 
<xs:element 



name="MPEG-2" 



<xs:complexType> 

<xs:choice> 
<xs:element 



<xs:simpleType> 
<xs: restriction 



base^xs-.string 1 ^ 



<xs:enumeration 



value=T/> 
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value="ll7> 
value="IH7> 

5 



name= ,, BackwardCompatibleMCLayer ,, > 

10 

base="xs:string"> 
value='TY> 

15 

value= M N7> 
value="lir7> 

20 



25 base= M xs:string"> 

value^'LowComplexity''^ 
value= n MainProfiie7> 
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<xs:enumeration 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element name= M MC M > 
<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

<xs:enumeration 
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value= M SamplingRateScaleableProfile'7> 



value= n, 7> 



10 



minOccurs="0 M > 



15 



name= n SyntheticProfile"> 



20 



base= u xs:string"> 



value="Level17> 



value= M Level27> 



25 value= M Level37> 



<xs:enumeration 



<xs:enumeration 



</xs:restriction> 
</xs:simpleType> 
</xs:element> 
</xs:choice> 
</xs:complexType> 
</xs:element> 

<xs:element name= M MPEG-4" 

<xs:complexType> 
<xs:choice> 
<xs:element 

<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

<xs;enumeration 

<xs:enumeration 



</xs:restriction> 
</xs:$impleType> 
</xs:element> 
<xs:element 



WO 03/091832 

name="SpeechProfile n > 
base-'xsistring'^ 

5 

value= M Level17> 
value= n Level27> 

10 

name="ScalableProfile"> 

15 

base-'xsistring'^ 
value="Level17> 
20 value= M Level2"/> 
value="Level37> 
value-tevel47> 

25 

name= M MainProfile M > 
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<xs:simpleType> 
<xs:restriction 

<xs:enumeration 

<xs:enumeration 

</xs: restriction 
</xs:simpleType> 
</xs:element> 
<xs: element 

<xs:simpleType> 
<xs:restriction 

<xs: enumeration 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 
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base="xs:string"> 



5 value="Leveirv> 



value="Level27> 



10 



15 



value= M Level37> 



value="Level47> 



name= M HighQulityProfile"> 



base="xs:string M > 

20 

va!ue= M Leve!17> 



value="Level27> 



25 value="Level37> 



value="Level47> 



value="Level57> 



<xs:simpleType> 
<xs:restriction 



<xs:enumeration 



<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs:restriction 

<xs:enumeration 



<xs:enumeration 



<xs:enumeration 



<xs:enumeration 



<xs:enumeration 
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value="Level6"/> 
value="Level77> 

5 

value="Level87> 



10 

name="LowDelayProfile"> 
base="xs:string"> 

15 

value="LeveI17> 
value="Level2"/> 
20 value="Level3"/> 
value="Level47> 
value="Level5"/> 

25 

value="Level6'7> 
value="Level7"/> 
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<xs: enumeration 

<xs:enumeration 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 



<xs:enumeration 
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va l U e="Level8'7: 



name= ,, NaturalProftle n > 



</xs:restriction> 
</xs:simpteType> 

</xs:element> 
<xs:element 

<xs:simpleType> 
<xs:restriction 



10 



base= n xs:string"> 



value="Leveir/> 



<xs:enumeration 



<xs: enumeration 



value="Level2'7> 



<xs:enumeration 



15 value= ,, Leve»3 l 7: 



<xs:enumeration 



value="Level4'7: 



20 



name 



="MobilelnternetworkingProfile M > 



</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 



25 base="xs:string M > 



<xs:enumeration 



value="Leveir7> 



<xs:enumeration 



value^'Level^ 
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<xs:enumeration 



vatue^Levett"/: 



<xs:enumeration 



value^'LeveWV: 



<xs:enumeration 



value= M Level5 n /: 



<xs:enumeration 



value^'Level^ 



10 



15 



20 



25 



</xs:restriction> 
</xs:simpleType> 

</xs:element> 

</xs:choice> 
</xs:complexType> 

</xs:element> 
</xs:sequence> 

♦ 

</xs:comp»exType> 
</xs:element> 

<xs:element name="»TU-T"> 

<xs:simpleType> 

<xs:restrictionbase="xs:string"> 

<xs:enumeration value="G.723"/> 
<xs:enumerationvalue="G.723.1"/> 
<xs:enumerat.on va»ue="G.726"/> 
<xs:enumerationvalue="G.728 t 7> 
<xs:enumerationvalue="G.729 , 7> 

</xs:restriction> 
</xs:simpleType> 

</xs:element> 

<xs:element na me="OtherCoding"> 
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<xs:simpleType> 

<xs:restrictionbase="xs:string"> 

<xs:enumeration value="AC3"/> 
^.enumeration value="DTS"/> 
^enumeration value=»AMR"/> 
5 ^.enumeration vaiue=«LPC^/> 

< X s:enumerationva»ue=«ATRAC»/> 
^enumeration v al ue=»ATRAC2»/> 
^.enumeration value="ATRAC3»/> 
</xs:reslriction> 

1° </xs:s"tmpleType> 

</xs:element> 

</xs:choice> 
</xs:comp»exType> 

</xs:element> - 
15 • <x ,element nanovideo" minOccurs= 0 

<xs:complexType> 

<xs:choice> 

<xs:eiement name="MPEG"> 

<xsxomp»exType> 

^.se^ence m axOccurs^unbound«l » 

piemen. n— 
^^boolean-minooours^ name ,. MP EG-2" 

25 minOccurs="0"> < x s:complexType> 

<xs:choice> 
<xs:element 



n ame="SimpleProfile"> 
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base="xs:string"> 



5 V alue="MainLevel'7> 



10 name="MainProfile"> 

base="xs:string"> 
15 V alue="LowLevel"/> 
value="MainLever7> 
value='Kigh1440Level'V> 

20 

value="HighLever/> 

25 

n ame="SNRScalableProfile<'> 
base= H xs:string n > 



<xs:simpleType> 
<xs:restrictton 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs:restriction 

<xs:enumeration 
<xs:eriumeration 
<xs: enumeration 
<xs:enumeration 

</xs:restriclion> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpieType> 
<xs: restriction 
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value^'LowLevel"^ 



va»ue= ,, MainLevel , 7> 



name= u SpatialSca]ableProfile ,f > 



10 



<xs:enumeration 
<xs:enumeration 

</xs: restriction 
</xs:simpleType> 

</xs:element> 
<xs:element 

<xs:simpleType> 
<xs:restriction 



15 



base="xs:stnng 



value="MainLevel7> 



va | U e="High1 440Level"/: 



value="HighLever7> 



20 



name="HighProfile": 



25 



base^xs-.string'^ 



value="MainLevel7> 



<xs: enumeration 
<xs:enumeration 
<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs:restriction 

<xs:enumeration 
<xs: enumeration 
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value="High1440Level7> 
va!ue= M HighLevel7> 

5 

name="MultiviewProfile"> 

10 

base="xs:string"> 
vaIue="MainLevel7> 

15 

name= , V422Profile"> 

20 

base= M xs:string M > 
value="MainLevel7> 

25 
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<xs: enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simp!eType> 
<xs; restriction 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
</xs:choice> 
</xs:complexType> 
</xs:element> 
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minOccurs="0"> 

name- 'Si mpleProfile n > 

base="xs: string"> 
value= M LevelO , 7> 
value=Tevel17> 
value=Tevel27> 
value= M Leve!3"/> 

name="ScaIableProfile M > 

base="xs:string"> 
value= M Leveir7> 
value="Level27> 
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<xs:element name="MPEG-4 M 

<xs:complexType> 
<xs:choice> 
<xs:element 

<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs:restriction 

<xs:enumeration 

<xs:enumeration 
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5 name 



=»AdvancedSimpleProfile n > 



</xs: restriction 
</xs:simp»eType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 



base= ,, xs:string"> 



<xs:enumeration 



10 value="Level07> 



<xs:enumeration 



value="Level17> 



<xs: enumeration 



15 



V alue="Level27> 



value="Level37> 



<xs:enumeration 



<xs:enumeration 



value= M Level47> 



<xs:enumeration 



20 value= n Level57> 



25 name="CoreProfile"> 



</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs: element 

<xs:simpieType> 
<xs:restriction 



base="xs:string"> 



<xs:enumeration 
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value="Level17> 
value='"Level27> 

5 

name= n CoreScalableProfile"> 

10 

base= M xs:string M > 
vaiue= M Level17> 
15 value="Level27> 
value="Level37> 

20 

name= M AdvancedCoreProfile"> 

25 base="xs:string"> 
value="Level1"/> 
value="Level2"/> 
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<xs: enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 

<xs: enumeration 

<xs: enumeration 

<xs: enumeration 

</xs:restriction> 
</xs:simp!eType> 
</xs:element> 
<xs: element 

<xs:simpleType> 
<xs:restriction 

<xs: enumeration 

<xs: enumeration 



VVO 03/091832 



5 name="MainProfile"> 

base="xs:string"> 
10 value="Level2"/> 
value="Level3'7> 
value="Leve»4"/> 

15 

> 

name="NbitProfile"> 

20 

base="xs:string H > 
valU e="Level27> 
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</xs: restriction 
</xs:simpleType> 

</xs:element> 
<xs:element 

<xs:simpleType> 
<xs:restriction 

<xs:enumeration 
<xs:enumeration 
<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 

</xs:element> 
<xs:element 

<xs:simpleType> 
<xs:restriction 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 



,=»AdvancedRealTimeSimpleProfile"> 
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base="xs:string"> 
5 value="Level17> 
value="Level2 ,, /> 
value= M Level37> 

10 

value="Level47> 

15 

name= n AdvancedCodingEfficiencyPr6file M > 
base= M xs:string n > 

20 

value="Level17> 
value="Level27> 
25 value="Level37> 
value=Tevel47> 



<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

<xs: enumeration 

<xs:enumeration 

<xs:enumeration 
■ 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs:restriction 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
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name-'SimpleStudioProfile'^ 

5 

base="xs:string M > 
value= M Level17> 
10 value=Tevel27> 
vaiue="Level37> 
value= M Level47> 

15 

name="CoreStudioProfile"> 

20 

base="xs:string"> 
value="Level17> 

25 

value="Level27> 
value= n Level37> 
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</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs:restriction 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 
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value= n Level47> 



5 

name^FGSProfile*^ 

base="xs:string ,, > 
value="Level07> 
value= M Leveir7> 
value="Level27> 
value=Tevel37> 
value="Level47> 
value="Level57> 

name="SimpleFaceAnimationProfile !, > 
base="xs:string"> 



</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

<xs: enumeration 

<xs: enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 
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<xs:enumeration 



va>ue="Level1 n /> 



<xs:enumeration 



value= l, Leve!2 , 7> 



name="SimpleFBAProf»le"> 



10 



</xs: restriction 
</xs:simpleType> 

</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 



base="xs:stnng 



<xs:enumeration 



15 



value="Level1'7> 



value= n Level2'7> 



20 



name 



=»BasicAnimatedTextureProfile"> 



<xs:enumeration 

</xs:restriction> 
</xs:stmpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 



25 



base="xs:string M > 



value= M LevelV7> 



<xs:enumeration 



<xs: enumeration 



value="Level27> 



</xs:restriction> 
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name= M ScalableTextureProfile"> 

5 

base="xs;string"> 
value= M Level17> 

10 

name="AdvancedScalableTextureProfiIe M > 

15 

base="xs:string n > 
value= M Level17> 

20 

value="Level27> 
value=Tevel37> 

25 

name="HybridProfile M > 



</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
<xs: restriction 

<xs:enumeration 

<xs:enumeration 

<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
<xs:element 

<xs:simpleType> 
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<xs:restriction 



base= ,l xs:string"> 



<xs:enumeration 



value^'Leveir^ 



<xs:enumeration 



value="Level27> 



10 



15 



20 



25 



</xs:restriction> 
</xs:simpleType> 

</xs:e!ement> 

</xs:choice> 
</xs:complexType> 

</xs:element> 
</xs:sequence> 
</xs:complexType> 

</xs:element> 

<xs:element name="ITU _T'> 
<xs:simpleType> 

<xs:restriction base="xs:string"> 
<xs:enumeration value="H26V7> 
<xs:enumeration value="H2637> 
</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs:element name="M-JPEG"> 
<xs:simp»eType> 

<xs:restriction base="xs:string"> 

<xs:enumeration 



v alue="mjp2ProfUe7> 



<xs:enumeration 
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value="mj2sProfile7> 



10 



value= M QuickTime'V> 



15 



20 



25 



</xs:restriction> 
</xs:simpleType> 
</xs:element> 

<xs:element name= H OtherCoding"> 
<xs:simpleType> 

<xs: restriction base="xs:string n > 

<xs:enumeration value= M RealVideo'7> 
<xs: enumeration value- WMV7> 
<xs:enumeration 

</xs:restriction> 
</xs:simpleType> 
</xs:element> 
</xs:choice> 
</xs:comp!exType> 
</xs:element> 

<xs:element name="lmageGraphic$" minOccurs="0"> 
<xs:simpleType> 

<xs: restriction base= M xs:string"> 

<xs:enumeration value="JPEG'7> 

<xs:enumeration value="JPEG20007> 

<xs:enumeration value='TIFF"/> 

<xs:enumeration value= M GIF7> 

<xs:enumeration value="XBM u /> 

<xs:enumeration value="PNG'7> 

<xs:enumeration value="'7> 
</xs:restriction> 



</xs:simpleType> 
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</xs:element> 

<xs:element name='Text n minOccurs-'O'^ 
<xs:complexType> 
<xs:choice> 

5 <xs:element name="ASCII" type="xs:boolean"/> 

<xs:element name= M Non-ASCH ,, > 
<xs:simp!eType> 

<xs:restriction base="xs:string"> 
<xs:enumeration value= n HTML7> 
1 0 <xs:enumeration value="ISO-8859- 

17> 

<xs:enumeration value="Shift_JIS7> 
</xs:restriction> 
</xs:simpleType> 
15 </xs:element> 

</xs:choice> 
</xs:complexType> 
</xs:element> 

<xs: element name-'ControlTerm" minOccurs=' , 0"> 
20 <xs:complexType> 

<xs: sequence maxOccurs="unbounded M > 

<xs:element name="DisplayWinSize" 

minOccurs= M 0"> 

<xs:complexType> 

25 <xs:attribute name-Width" 

type="xs: integer" use="required'7> 

<xs:attribute name= M Height" 

type="xs: integer" use="required"/> 

</xs:complexType> 
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</xs:element> 
<xs:element 



name="PictureSize" 



minOccurs="0"> 



10 



<xs:complexType> 
<xs:attribute 

type="xs: integer" use="required7> 

<xs: attribute 

type-'xs: integer" use="required"/> 

</xs:complexType> 
</xs:element> 



name^Width" 



name-'Height" 



<xs:element name="Bitrate" type="xs: integer" 



minOccurs= H 07> 



15 



20 



25 



<xs:element 
type= M xs:integer" minOccurs="0"/> 

<xs:element 
type="xs: integer" minOccurs="07> 

</xs:sequence> 
</xs:complexType> 
</xs:element> 
</xs:sequence> 
</xs:complexType> 
</xs:element> 
</xs:sequence> 
</xs:complexType> 
</xs:element> 
</xs:schema> 



name="BufferSize" 



name="FrameRate" 



EFFECTS OF INVENTION 

A multimedia framework built with the defined mechanism is able to adapt to 
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different formats of content across different terminals and networks, which will 
be used in content retrieval, content delivery, Video-on-Demand, digital library 
service, etc. 

A terminal built with the defined structured DIA descriptions is able to access, 
5 retrieve, and consume content in different formats, and it is able to use in 
different applications and different network conditions to expand its usefulness. 

An adaptation gateway built with the defined structured DIA descriptions is 
able to parse and process the input content with its DIA descriptions, to convert 
the content into another format to match with the required format used in the 
1 0 supported terminals. 

A server built with the defined structured DIA descriptions is able to select 
adaptation tools to convert content from one into another format, to match with 
the required format by a terminal, so that it can serve for variety of terminals to 
expand its business scale. 
15 A mechanism is introduced to use such DIA Descriptions in real-time 
streaming content delivery applications where both terminal and server are 
implemented with such DIA Descriptions Generation and DIA Parser. 

The invention can have the following structures viewed from various aspects. 
According to the first, method of content adaptation for an Apparatus of 
20 Universal Multimedia Framework Terminal, including following steps of: 

building a terminal with content decoding tools that is compliant to certain 
standard; 

describing the terminal using DIA (Digital Item Adaptation) Descriptions; 
attaching the DIA Descriptions to the terminal; 
25 sending and submitting the DIA Descriptions to a server for retrieving a 
piece of content, whereby the server is parsing and processing the DIA 
Descriptions; 

selecting the content which is in the matched format with the DIA Description 
submitted by the terminal; and 



WO 03/091832 



PCT/JP03/05163 



54 

delivering the content to the terminal. 

According to the second, method of content adaptation for an Apparatus of 
Universal Multimedia Framework Terminal, including the following steps of: 
building a terminal with content coding tools that is compliant to certain 
5 standard; 

describing the terminal using DIA (Digital Item Adaptation) Descriptions; 
attaching the DIA Descriptions to the terminal; * 
implementing a DIA Description Generator in the terminal to be able to 

generate DIA Descriptions on-line; 
10 generating DIA Descriptions on-line to describe network condition and user 

preference based on network protocol, other tools, or user preference in the 

terminal; 

sending and submitting the DIA Descriptions to a server for retrieving a 
piece of content, whereby the server is parsing and processing the DIA 
15 Descriptions; 

selecting the content which is in the matched format with the DIA Description 
submitted by the terminal; and 

delivering the content to the terminal. 

According to the third, method of content adaptation for an Apparatus of 
20 Universal Multimedia Framework Terminal, including the following steps of: 

building a terminal with content coding tools that is compliant to certain 
standard; 

describing the terminal using DIA (Digital Item Adaptation) Descriptions; 

attaching the DIA Descriptions to the terminal; 
25 implementing a DIA Description Generator in the terminal to be able to 
generate DIA Descriptions on-line; 

generating DIA Descriptions on-line to describe network condition and user 
preference based on network protocol, other tools, or user preference in the 
terminal; 
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implementing a DID (Digital Item Declaration) Parser, IPMP (Intellectual 
Property Management and Protection) Parser, REL (Rights Expression 
Language) Parser, RDD (Rights Data Dictionary) Parser, and DIA Parser in the 
terminal to be able to parse DID, IPMP, REL, RDD, and DIA descriptions 
5 browsing a Dl (digital Item) with its DID, IPMP, REL, RDD, and DIA 
Description; 

selecting "choice" notes in DID menu by the terminal; 
parsing IPMP, REL, RDD, and DIA descriptions in DID menu in the terminal 
if there is such description appearing in the DID menu; 
10 submitting the DIA Descriptions used to describe the terminal, the network 
condition, and the user preference to a server for retrieving a piece of content 
when there is such DIA note met in the DID menu, whereby the server is 
parsing and processing the DIA Descriptions; 

selecting the content which is in the matched format with the DIA Description 
15 submitted by the terminal; and 

delivering the content to the terminal. 

According to the fourth, method of content adaptation for an Apparatus of 
Universal Multimedia Framework Gateway, including the following steps of: 

building an adaptation gateway with transcoding function; 
20 building an adaptation gateway with a DIA Parser; 

describing terminal using DIA (Digital Item Adaptation) Descriptions, 
attached to the terminal; 

registering the DIA Descriptions into the adaptation gateway for each of the 
terminal supposed to be supported by the adaptation gateway; 
25 receiving content with its DIA descriptions in the adaptation gateway; 

parsing the received DIA descriptions used to describe the content by the 
DIA Parser in the adaptation gateway; 

comparing the parsed DIA descriptions used to describe for the content with 
the DIA descriptions used to describe for the terminal; 
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Universal Multimedia Framework Server, including the following steps of: 

building a multimedia server with stored multimedia contents; 

creating DIA descriptions for each content; 

attaching the DIA descriptions to the corresponding content; 
5 implementing a DIA Parser in the server; 

implementing or plugging-in adaptation tools in the server to be able to 
perform transcoding functions between different multimedia formats; 

pre-transcoding and storing the content in the server to several popular 
coding formats using the above the adaptation tools; 
10 receiving a set of DIA descriptions from a terminal via any means, wherein 
the set of DIA descriptions are used to describe for the terminal decoding 
capability, network condition used, as well as user preference; 

parsing the set of DIA descriptions by the server; 

selecting the stored content in the server, which is in the required format that 
1 5 is described by the DIA Descriptions submitted by the terminal; 

generating a new set of DIA descriptions to describe the transcoded content; 
attaching the new set of DIA descriptions to the transcoded content as its 
metadata; 

delivering the content with the matched coding format, network condition, 
20 and user preference to the terminal. 

According to the seventh, method of content adaptation for an Apparatus of 
Universal Multimedia Framework Server, including the following steps of: 

building a multimedia server with stored multimedia contents; 

creating DIA descriptions for each content; 
25 attaching the DIA descriptions to the corresponding content; 

implementing a DIA Parser in the server; 

implementing or plugging-in adaptation tools in the server to be able to 
perform transcoding functions between different multimedia formats; 

providing IPMP, REL, RDD, and DIA descriptions in DID menu for user to 
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view and select; 

making choices from the DID menu by the user who is using a terminal; 

receiving a set of DIA descriptions from the terminal during the choice 
making, wherein the set of DIA descriptions are used to describe the terminal 
5 decoding capability; 

receiving a set of DIA descriptions from the terminal during the choice 
making, wherein the set of DIA descriptions are used to describe the network 
condition and user preference; 

parsing the above the set of DIA descriptions by the server; 
10 selecting the adaptation tools to perform transcoding to convert from one 
format to another in the server, according to the parsing results mentioned in 
the above step; 

generating a new set of DIA descriptions to describe the transcoded content; 
attaching the new set of DIA descriptions to the transcoded content as its 
15 metadata; 

delivering the content with the matched coding format, network condition, 
and user preference to the terminal. 

According to the eighth, method of content adaptation for an Apparatus of 
Universal Multimedia Framework Server, including the following steps of: 
20 building a multimedia server with stored multimedia contents; 

creating DIA descriptions for each content; 

attaching the DIA descriptions to the corresponding content; 

implementing a DIA Parser in the server; 

implementing or plugging-in adaptation tools in the server to be able to 
25 perform transcoding functions between different multimedia formats; 

pre-transcoding and storing the content in the server to several popular 
coding formats using the above the adaptation tools; 

providing IPMP, REL, RDD, and DIA descriptions in DID menu for user to 
view and select; 
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making choices from the DID menu by the user who is using a terminal; 

receiving a set of DIA descriptions from the terminal during the choice 
making, wherein the set of DIA descriptions are used to describe the terminal 
decoding capability; 

5 receiving a set of DIA descriptions from the terminal during the choice 
making, wherein the set of DIA descriptions are used to describe the network 
condition and user preference; 

parsing the above the set of DIA descriptions by the server; 
selecting the stored content in the server, which is in the required format that 
10 is described by the DIA Descriptions submitted by the terminal; 

generating a new set of DIA descriptions to describe the transcoded content; 
attaching the new set of DIA descriptions to the transcoded content as its 
metadata; 

delivering the content with the matched coding format, network condition, 
1 5 and user preference to the terminal. 

According to the ninth, method of content adaptation for an Apparatus of 
Universal Multimedia Framework Terminal, according to the above, further 
including the following steps of: 

describing the terminal by using a hierarchy structure, including terminal 
20 general feature, terminal hardware, terminal software, terminal system, and 
terminal decoding capability as the 1 st layer; 

describing the terminal decoding capability in different coding layers, from 
primary content, source decoding layer, system decoding layer, transmission 
layer, to the DIA descriptions; 
25 defining detail descriptions in each coding layer including coding and 
decoding parameters, to indicate the maximum supporting ranges by the 
terminal for different parameters used in the decoding process; 

defining controlling terms to use in the DIA descriptions mentioned in the 
above, which is a set of common terms and used to signal between the terminal 
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defining controlling terms to use in the DIA descriptions mentioned in the 
above, which is a set of common terms and used to signal between the terminal 
and the server; and 

creating the DIA descriptions in the form of SDL (Syntactic Description 
5 Language). 

According to the twelfth, method of content adaptation for an Apparatus of 
Universal Multimedia Framework Terminal, according to the above method, 
wherein network condition that is related to content format adaptation is 
described by defining controlling terms, like bandwidth, delay, and packet loss; 
10 and 

user preference that is related to content format adaptation is described by 
defining controlling terms, like quality, color, size, streaming, downloading, 
filtering with their attributes; further including the following steps of: 

receiving network condition in the terminal from network protocol, other 
1 5 private tools, or user input; 

converting the received parameters on network condition in the terminal into 
the DIA descriptions by using the controlling terms defined in the above steps; 
receiving user preference in the terminal from User Interface; and 
converting the received parameters on user preference in the terminal into 
20 the DIA descriptions by using the controlling terms defined in the above steps. 

According to the thirteenth, an apparatus of universal multimedia framework 
terminal, the terminal connected to a server via a network, including: 
a memory device in which content decoding tools are stored; 
a DIA descriptor for describing the terminal using DIA description; 
25 an attaching element for attaching the DIA descriptions to the terminal; 

a transmitter for sending the DIA descriptions and a content requirement to a 
server for retrieving a piece of content; and 

a receiver for receiving the content selected and delivered from the server. 
According to the fourteenth, an apparatus of universal multimedia framework 
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gateway, the gateway provided between a terminal and a server, including: 
a memory device; 

a DIA descriptor for describing the terminal using DIA description; 
a first attaching element for attaching the DIA descriptions to the terminal; 
5 a register for registering a DIA descriptions attached to the terminal into the 
memory device; 

a receiver for receiving a content with its DIA descriptions according to a 
content requirement of the terminal from the server; 

a DIA parser for parsing the received DIA descriptions attached to the 
10 content; 

a comparator for comparing the parsed DIA descriptions with the DIA 
descriptions for the terminal; 

a transcoder for transcoding the content from one format to another format, if 
format mismatch is found between the one format of the content and another 
1 5 format described in the DIA descriptions for the terminal; 

a generator for generating a new set of DIA descriptions to describe the 
transcoded content; 

a second attaching element for attaching the new set of DIA descriptions to 
the transcoded content; and 
20 a transmitter for sending the content to the terminal. 

According to the fifteenth, an apparatus of universal multimedia framework 
server, the server connected to a terminal via a network, including: 

a memory device in which multimedia contents are stored; 

a creator for creating DIA description for the each content; 
25 a first attaching element for attaching the DIA description to the 
corresponding content; 

a receiver for receiving a set of DIA descriptions from a terminal, the set of 
DIA descriptions being used to describe for the terminal decoding capability, 
network condition, as well as user preference; 
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a DIA parser for parsing the received DIA description for the terminal; 

adaptation tools for transcoding the content between different multimedia 
formats of contents; 

a selector for selecting one adaptation tool to transcode to convert the 
5 content from one format to another format according to the parsing results; 

a generator for generating a new set of DIA descriptions to describe the 
transcoded content; 

a second attaching element for attaching the new set of DIA descriptions to 
the transcoded content as its metadata; and 
10 a delivering element for delivering the content to the terminal. 

Although the present invention has been described in connection with the 
preferred embodiments thereof with reference to the accompanying drawings, it 
is to be noted that various changes and modifications are apparent to those 
skilled in the art. Such changes and modifications are to be understood as 
15 included within the scope of the present invention as defined by the appended 
claims, unless they depart therefrom. 
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CLAIMS 

1 . Method of content adaptation for an Apparatus of Universal Multimedia 
Framework Terminal, comprising following steps of. 

building a terminal with content decoding tools that is compliant to certain 
5 standard; 

describing the terminal using DIA (Digital Item Adaptation) Descriptions; 
attaching the DIA Descriptions to the terminal; 

sending and submitting the DIA Descriptions to a server for retrieving a piece 
of content, whereby the server is parsing and processing the DIA Descriptions; 
10 selecting the content which is in the matched format with the DIA Description 
submitted by the terminal; and 

delivering the content to the terminal. 

2. Method of content adaptation for an Apparatus of Universal Multimedia 
Framework Terminal, comprising the following steps of: 

15 building a terminal with content coding tools that is compliant to certain 
standard; 

describing the terminal using DIA (Digital Item Adaptation) Descriptions; 
attaching the DIA Descriptions to the terminal; 

implementing a DIA Description Generator in the terminal to be able to 
20 generate DIA Descriptions on-line; 

generating DIA Descriptions on-line to describe network condition and user 
preference based on network protocol, other tools, or user preference in the 
terminal; 

sending and submitting the DIA Descriptions to a server for retrieving a piece 
25 of content, whereby the server is parsing and processing the DIA Descriptions; 

selecting the content which is in the matched format with the DIA Description 
submitted by the terminal; and 

delivering the content to the terminal. 

3. Method of content adaptation for an Apparatus of Universal Multimedia 
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Framework Terminal, comprising the following steps of: 

building a terminal with content coding tools that is compliant to certain 
standard; 

describing the terminal using DIA (Digital Item Adaptation) Descriptions; 
5 attaching the DIA Descriptions to the terminal; 

implementing a DIA Description Generator in the terminal to be able to 
generate DIA Descriptions on-line; 

generating DIA Descriptions on-line to describe network condition and user 
preference based on network protocol, other tools, or user preference in the 
10 terminal; 

implementing a DID (Digital Item Declaration) Parser, IPMP (Intellectual 
Property Management and Protection) Parser, REL (Rights Expression 
Language) Parser, RDD (Rights Data Dictionary) Parser, and DIA Parser in the 
terminal to be able to parse DID, IPMP, REL, RDD, and DIA descriptions 
15 browsing a Dl (digital Kern) with its DID, IPMP, REL, RDD, and DIA 
Description; 

selecting "choice 0 notes in DID menu by the terminal; 

parsing IPMP, REL, RDD, and DIA descriptions in DID menu in the terminal 
if there is such description appearing in the DID menu; 
20 submitting the DIA Descriptions used to describe the terminal, the network 
condition, and the user preference to a server for retrieving a piece of content 
when there is such DIA note met in the DID menu, whereby the server is 
parsing and processing the DIA Descriptions; 

selecting the content which is in the matched format with the DIA Description 
25 submitted by the terminal; and 

delivering the content to the terminal. 
4. Method of content adaptation for an Apparatus of Universal Multimedia 
Framework Gateway, comprising the following steps of: 

building an adaptation gateway with transcoding function; 
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7. Method of content adaptation for an Apparatus of Universal Multimedia 
Framework Server, comprising the following steps of: 

building a multimedia server with stored multimedia contents; 
5 creating DIA descriptions for each content; 

attaching the DIA descriptions to the corresponding content; 
implementing a DIA Parser in the server; 

implementing or plugging-in adaptation tools in the server to be able to 
perform transcoding functions between different multimedia formats; 
10 providing IPMP, REL, RDD, and DIA descriptions in DID menu for user to 
view and select; 

making choices from the DID menu by the user who is using a terminal; 

receiving a set of DIA descriptions from the terminal during the choice 
making, wherein the set of DIA descriptions are used to describe the terminal 
1 5 decoding capability; 

receiving a set of DIA descriptions from the terminal during the choice 
making, wherein the set of DIA descriptions are used to describe the network 
condition and user preference; 

parsing the above the set of DIA descriptions by the server, 
20 selecting the adaptation tools to perform transcoding to convert from one 
format to another in the server, according to the parsing results mentioned in 
the above step; 

generating a new set of DIA descriptions to describe the transcoded content; 
attaching the new set of DIA descriptions to the transcoded content as its 
25 metadata; 

delivering the content with the matched coding format, network condition, 
and user preference to the terminal. 

8. Method of content adaptation for an Apparatus of Universal Multimedia 
Framework Server, comprising the following steps of: 
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general feature, terminal hardware, terminal software, terminal system, and 
terminal decoding capability as the 1 st layer; 

describing the terminal decoding capability in different coding layers, from 
primary content, source decoding layer, system decoding layer, transmission 
5 layer, to the DIA descriptions; 

defining detail descriptions in each coding layer including coding and 
decoding parameters, to indicate the maximum supporting ranges by the 
terminal for different parameters used in the decoding process; 

defining controlling terms to use in the DIA descriptions mentioned in the 
10 above, which is a set of common terms and used to signal between the terminal 
and the server. 

10. Method of content adaptation for an Apparatus of Universal Multimedia 
Framework Terminal, according to claim 1, further comprising the following 
steps of: 

15 describing the terminal by using a hierarchy structure, including terminal 
general feature, terminal hardware, terminal software, terminal system, and 
terminal decoding capability as the 1st layer; 

describing the terminal decoding capability in different coding layers, from 
primary content, source decoding layer, system decoding layer, transmission 
20 layer, to the DIA descriptions; 

defining detail descriptions in each coding layer including coding and 
decoding parameters, to indicate the maximum supporting ranges by the 
terminal for different parameters used in the decoding process; 

defining controlling terms to use in the DIA descriptions mentioned in the 
25 above, which is a set of common terms and used to signal between the terminal 
and the server; and 

expressing the DIA descriptions in XML to provide extensibility. 

1 1 . Method of content adaptation for an Apparatus of Universal Multimedia 
Framework Terminal, according to claim 1, further comprising the following 
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steps of: 

describing the terminal by using a hierarchy structure, including terminal 
general feature, terminal hardware, terminal software, terminal system, and 
terminal decoding capability as the 1st layer; 
5 describing the terminal decoding capability in different coding layers, from 
primary content, source decoding layer, system decoding layer, transmission 
layer, to the DIA descriptions; 

defining detail descriptions in each coding layer including coding and 
decoding parameters, to indicate the maximum supporting ranges by the 
1 0 terminal for different parameters used in the decoding process; 

defining controlling terms to use in the DIA descriptions mentioned in the 
above, which is a set of common terms and used to signal between the terminal 

and the server; and 

creating the DIA descriptions in the form of SDL (Syntactic Description 

15 Language). 

12. Method of content adaptation for an Apparatus of Universal Multimedia 
Framework Terminal, according to claim 2, wherein network condition that is 
related to content format adaptation is described by defining controlling terms, 
like bandwidth, delay, and packet loss; and 
20 user preference that is related to content format adaptation is described by 
defining controlling terms, like quality, color, size, streaming, downloading, 
filtering with their attributes; further comprising the following steps of: 

receiving network condition in the terminal from network protocol, other 
private tools, or user input; 
25 converting the received parameters on network condition in the tenminal into 
the DIA descriptions by using the controlling terms defined in the above steps; 
receiving user preference in the terminal from User Interface; and 
converting the received parameters on user preference in the terminal into 
the DIA descriptions by using the controlling terms defined in the above steps. 
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13. An apparatus of universal multimedia framework terminal, the terminal 
connected to a server via a network, comprising: 

a memory device in which content decoding tools are stored; 
a DIA descriptor for describing the terminal using DIA description; 
5 an attaching element for attaching the DIA descriptions to the terminal; 

a transmitter for sending the DIA descriptions and a content requirement to a 
server for retrieving a piece of content; and 

a receiver for receiving the content selected and delivered from the server. 

14. An apparatus of universal multimedia framework gateway, the gateway 
1 0 provided between a terminal and a server, comprising: 

a memory device; 

a DIA descriptor for describing the terminal using DIA description; 
a first attaching element for attaching the DIA descriptions to the terminal; 
a register for registering a DIA descriptions attached to the terminal into the 
15 memory device; 

a receiver for receiving a content with its DIA descriptions according to a 
content requirement of the terminal from the server; 

: a DIA parser for parsing the received DIA descriptions attached to the 
content; 

20 a comparator for comparing the parsed DIA descriptions with the DIA 
descriptions for the terminal; 

a transcoder for transcoding the content from one format to another format, if 
format mismatch is found between the one format of the content and another 
format described in the DIA descriptions for the terminal; 
25 a generator for generating a new set of DIA descriptions to describe the 
transcoded content; 

a second attaching element for attaching the new set of DIA descriptions to 
the transcoded content; and 

a transmitter for sending the content to the terminal. 
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15. An apparatus of universal multimedia framework server, the server 
connected to a terminal via a network, comprising: 

a memory device in which multimedia contents are stored; 

a creator for creating DIA description for the each content; 
5 a first attaching element for attaching the DIA description to the 
corresponding content; 

a receiver for receiving a set of DIA descriptions from a terminal, the set of 
DIA descriptions being used to describe for the terminal decoding capability, 
network condition, as well as user preference; 
10 a DIA parser for parsing the received DIA description for the terminal; 

adaptation tools for transcoding the content between different multimedia 

formats of contents; 

a selector for selecting one adaptation tool to transcode to convert the 
content from one format to another format according to the parsing results; 
15 a generator for generating a new set of DIA descriptions to describe the 

transcoded content; 

a second attaching element for attaching the new set of DIA descriptions to 

the transcoded content as its metadata; and 

a delivering element for delivering the content to the terminal. 
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